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"^j ' Sequential Monte Carlo (SMC) methods are a class of techniques to sample approximately 

C^ \ from any sequence of probability distributions using a combination of importance sampling and 

resampling steps. This paper is concerned with the convergence analysis of a class of SMC 
methods where the times at which resampling occurs are computed online using criteria such 
as the effective sample size. This is a popular approach amongst practitioners but there are 
very few convergence results available for these methods. By combining semigroup techniques 
with an original coupling argument, we obtain functional central limit theorems and uniform 
exponential concentration estimates for these algorithms. 
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O ■ 1. Introduction 

Sequential Monte Carlo (SMC) methods are a generic class of simulation-based algo- 
rithms to sample approximately from any sequence of probability distributions. These 
k> ' methods are now extensively used in engineering, statistics and physics; see [1, 4, 7, 8] for 

^ , many applications. Sequential Monte Carlo methods approximate the target probability 

distributions of interest by a large number of random samples, termed particles, which 
evolve over time according to a combination of importance sampling and resampling 
steps. 

In the resampling steps, new particles are sampled with replacement from a weighted 
empirical measure associated to the current particles; see Section 2.2 for more details. 
These resampling steps are crucial and, without them, it is impossible to obtain time uni- 
form convergence results for SMC estimates. However, resampling too often has a neg- 
ative effect as it decreases the number of distinct particles. Hence, a resampling step 
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should only be applied when necessary. Consequently, in most practical implementations 
of SMC, the times at which resampling occurs are selected by monitoring a criterion 
that assesses the quality of the current particle approximation. Whenever this criterion 
is above or below a given threshold, a resampling step is triggered. This approach was 
originally proposed in [9] and has been widely adopted ever since [1], Section 7.3.2. 

For this class of adaptive SMC methods, the resampling times are computed online 
using our current SMC approximation and thus are random. However, most of the theo- 
retical results on SMC algorithms assume resampling occurs at deterministic times; see [6] 
for an exception discussed later. The objective of this paper is to provide convergence 
results for this type of adaptive SMC algorithm. This is achieved using a coupling ar- 
gument. Under some assumptions, the random resampling times converge almost surely 
as the number of particles goes to infinity toward some deterministic (but not explicitly 
known) resampling times. We show here that the difference, in probability, between the 
reference SMC algorithm based on these deterministic but unknown resampling times 
and the adaptive SMC algorithm is exponentially small in the number of particles. This 
allows us to straightforwardly transfer the convergence results of the reference SMC al- 
gorithm to the adaptive SMC algorithm. In particular, we establish functional central 
limit theorems and new exponential concentration estimates that improve over those pre- 
sented in [4], Section 7.4.3. Note that some exponential concentration estimates have also 
been established in [1], Theorem 9.4.12, using different techniques and a weaker assump- 
tion. The constants appearing in [1], Theorem 9.4.12, arc not explicit so the comparison 
between these two results is difficult. In a specific example, we found our bound to be 
significantly tighter but have not established it in a general case. 

The rest of the paper is organized as follows. In Section 2, we present the class of adap- 
tive SMC algorithms studied here and our main coupling result. A precise description 
of the sequence of distributions approximated by the reference SMC algorithm is given 
in Section 3 and a theoretical analysis of the reference SMC algorithm is presented in 
Section 4. In particular, we propose an original concentration analysis to obtain exponen- 
tial estimates for SMC approximations. These results are used to obtain a concentration 
result for the empirical criteria around their limiting values. The results above are used, 
in Section 5, to bound the differences between the deterministic resampling times and 
their empirical approximations, up to an event with an exponentially small probability. 
Finally, we analyze the fluctuations of adaptive SMC algorithms in Section 6. 

2. Adaptive SMC algorithms and main results 
2.1. Notation and conventions 

Let M.{E), VlE) and Bb{E) denote, respectively, the set of bounded and signed mea- 
sures, the subset of all probability measures on some measurable space (_E, (o) and the 
Banach space of all bounded and measurable functions f on E when equipped with 
norm |j/|| = sup^.^^; |/(a;)|. Osci(i?) is the set of ^-measurable functions / with oscil- 
lations osc(/) = supf^^ y)^E2 {\f{x) - f{y)\} < 1. /x(/) = Jfi{dx)f{x) is the integral of 
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a function / G Bb{E), w.r.t. a measure /x G M{E). n{A) = /x(1a) with AGS' and 1a the 
indicator of ^. (5^ is the Dirac measure. A bounded integral operator M from a measur- 
able space {E,(a) into another (F,^) is an operator / n- M(/) from Bb{F) into Bb{E) 
such that the functions M{f){x) = JpM{x,dy)f{y) arc measurable and bounded for 
any / € Bb{F). A bounded integral operator Af from (E^S) into (F,^) also generates 
a dual operator /x k^ /xA/ from M{E) into A^(i^) defined by {^M){J) := ^{M{f)). If con- 
stants are written with an argument, then they depend only on this given argument. The 
tensor product of functions is written ®. For any generic sequence {zn\n>Q, we denote 
Zi;j = {zi, Zi+i,. . . , Zj) for i < j. 

2.2. Adaptive sequential Monte Carlo methods 

SMC methods are a popular class of methods for sampling random variables distributed 
approximately according to the Feynman-Kac path measures 

'?:(/«) -7:(/n)/7:(l) with 7:(/n) =IE(/„(^0:n)W-0:„-l(^l:„-l)), (2.1) 

V:{fn) = ln{fn)/TnW with 7:(/„) = E(/„ (Xo:„) W^O:™ (^l:,.)) , (2.2) 

where (X„)„>o is a Markov chain on {En,S'n)n>o with transition kernels (Af„)„>o, 
(G„)„>o is a sequence of non- negative potential functions on {En)n>o and the importance 
weight function is defined by 

Wp^q-.Xp+l-.q&Ep+lX ---X Eq^Wp^q{Xp+l..q):= ]^ Gk{Xk). (2.3) 

p<k<q 

The basic SMC method proceeds as follows. Given N particles distributed approx- 
imately according to ?7^_i, these particles first evolve according to the transition ker- 
nel A'/„. In a second stage, particles with low relative G„ -potential value arc killed and 
those with a larger relative potential are duplicated. However, as noted in Section 1, 
resampling at each time step is wasteful and should only be performed when necessary. 

This has motivated researchers to introduce new resampling strategies where the re- 
sampling step is only triggered when a criterion is satisfied; this is typically computed 
via the current particle approximation (see Section 2.3). Such adaptive SMC algorithms 
proceed as follows. Let t^ denote the nth resampling time of the adaptive SMC algo- 
rithm. After the nth resampling step, assume we have the following empirical measure 
approximation oi rfj:^ denoted 

1 ^ 

i=l 

where 3^„ ' := ?q jw • We propagate forward these N paths by generating ^jnjI^.jn 
according to the transition kernel M^n^i.^n := AfjN_|_j A/(jv^2 ' ' ' -^^t" of the reference 
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Markov chain initialized at Y.^ '' , up to the first time {t^^i) the importance weights of 
the N path samples given by W^n jn^^ (i^/wXifW ) become, in some sense, degenerate. 

V 



At time t^j^i the weighted occupation measure of the system 



N 



(N.i) 






TjfN I'):— > — -Tj ,^j ■^ 0.,(jv,i)r) 

■^ n + i '•^ ^ Ti + l 

is a particle approximation of rflu {.), where !V„_i_i := (!Vn ' j VNili.tiv )■ After the 

Tl + l 71 "I" Tl + l 

resampling step, this measure is replaced by an empirical measure 

N 



C(-)-^E^.--(-) 



associated with N path particles 3^„4_'i := Y^ ^n that are resampled from -q*^ ; see, for 
example, [7] for alternative resampling schemes. 

2.3. Some empirical criteria 

Two well-known criteria used in the SMC literature to trigger the resampling mechanism 
are now discussed. In both cases, the resampling times {t^)n>o are random variables 
that depend on the current SMC approximation. 

• Squared coefficient of variation. After the resampling step at time i„ , the particles 
explore the state space up to the first time (s = i^+i) the squared coefficient of variation 
of the unnormalized weights is larger than some prescribed threshold a„ 

1 ^ 

*~.(>;5^t)/^E^*^^(^/^l)) -1^-- (2-4) 

This is equivalent to resampling when the effective sample size (ESS), defined as ESS = 
A^(l + C^ s)~^' ^^ below a prescribed threshold as proposed in [9]. 

• Entropy. After the resampling step at time t^ , the particles explore the state space 
up to the first time (s — tn+i) the relative entropy of the empirical particle measure w.r.t. 
its weighted version is larger than some threshold a„ 




1 

^*«,. ■= -l^El°gw^*^^(4^+l J ^ «»■ (2-5) 



1=1 



2.4. Statement of some results 

The following section provides a guide of the major definitions and results in this paper; 
these will be repeated at the relevant stages in the paper. 
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2. 4-1- A limiting reference SMC algorithm 

Let (i„)„>o be the deterministic sequence of time steps obtained by replacing the 
empirical criteria C^^ g by their limiting values Cj^.g as N '\ c», that is, t„+i := 

inf {i„ < s: Ct^^s > ««}■ In all situations, set tg = to = 0. For the criterion (2.4), the 
limiting criterion Cj^.s is given by 

Et„,ff:JWt„,s{Xt„ + l:sW ' 

whereas for (2.5) it is given by 

-Et^^^,J\0gWt„^siXt^ + l:s))- (2.7) 

Here, Et„,fi* is the expectation w.r.t. the law Ft^^fj* of the random path of variables that 

starts at time i„ at the end point Xt^ ~ Xt„ of Xn ■= X^-t^ distributed according to rf^^ 
and evolves according to the Markov kernels Mt^+i-s- In [3], the limiting expression for the 
normalized effective sample size N~^ESS has been established. An alternative entropy 
criterion has also been proposed that can be applied when the potential functions (G„)„>o 
are not strictly positive on {En)n>o- 

2.4-2. An exponential coupling theorem 

We give our main results, which hold under the following regularity condition: 

(G) Vn>l q'^:= sup (G„(a;)/G„(y)) < oo. (2.8) 

We refer the reader to [4], Chapter 3, for a thorough discussion in the case where (G) 
does not apply. To state our results, we first require the following definition. 

Definition2.1. Letyi^^ := {yl^''\y^J'''\. . .,yi''^''^) andyi""^ := {yir''\y^J'''\. . ., 
yn ' ) denote the N particles associated to the adaptive SMC algorithm resampling at 
trmes (C)n>o and let xl^^ := {xi''^'\xi''-'\ . . . ,xi''-''^) and X^f'^ := {xi'' ''\ X^'' ''\ 

\clt 

'OS: 

time interval < n <m, once t^ = i„, for every < n< m. This condition corresponds 
to the coupling of the two processes on the event C\Q<:„<m{^n —tn}- 

The first result is a non-asymptotic exponential concentration estimate. The proba- 
bility measures t]^ and rjn are introduced below. They can be thought of as analogues 
of ril^ and tjI ; see Section 3 for formal definitions. 

Theorem 2.2. For any n > 0, /„ G Osci(£'o x • • • x Et^), any N >1 and any <e < 
1/2, there exist ci < oo, < C2{n) < oo such that we have the exponential concentration 
estimate 

nilvH - Vj{fn)\ >e)<ci exp{-Neyc2{n)} 



. . . , Xn ' ) denote the N particles associated to the reference SMC algorithm resampling 
at times (i„)„>o- We also suppose that {Xn ,Xn ) and {yn ,3^n ) coincide on every 
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for the empirical measures rj^ {■) = Tf y^7=i '^/■i;(«') v-c.*) ^(■)• -^'^ addition, under ap- 

propriate regularity conditions on {Mk)k>o o,nd {Gk)k>o given in Section 4.2.1 the 
above estimates are valid for the marginal measures associated to the time parameters 
tn-i <p<tn for some constant C2{n) = ci. 

The second result is an exponential coupling theorem. 

Theorem 2.3. Assume the threshold parameters (a„)„>o are sampled realizations of 
a collection of absolutely continuous random variables A= (A„)„>o. Then, for almost 

every realization of the sequence (A„)„>o, {Xn ,Xn ),i>o and (J^i ' ,yn )n>o o.re 
such that, for every m > and any N >1, there exist < ci(77i), C2{m) < oo and almost 
surely e{m, A) = e{m) > such that 

P(30 < n < m (3^(^\5^W) ^ (A'W,^W)|A) < ci(™)c-^^'('")/=^('"). 



Up to an event having an exponentially small occurrence probability, Theorem 2.3 
allows us to transfer many estimates of the reference SMC algorithm {X,] ,Xn )n>o 
resampling at deterministic times to the adaptive SMC algorithm (3^„ ,yn )n>o- 

The proofs of Theorems 2.2 and 2.3 are detailed, respectively, in Sections 4.2.3 and 5.2. 



3. Description of the models 
3.1. Feynman— Kac distributions flow 

We consider a sequence of measurable state spaces {Sn,'5^n)n>o, a probability measure 
770 S 'P('S'o) and a sequence of Markov transitions 7W„(a;„_i,da;„) from 5„_i into Sn 
for n>l. Let (A'„)„>o be a Markov chain with initial distribution Law(A'o) = 770 and 
elementary transitions P(A'„ e dy\Xn-i = x) = A^„(a;,dy). Let {Gn)n>o be a sequence of 
non- negative and bounded potential functions on Sn- To simplify the presentation, and 
to avoid unnecessary technicalities, it is supposed Gn G (0, 1) for 71 > 1 with 

(G) <7n := sup {Gnix)/Gniy)) <'X. (3.1) 

The Boltzmann-Gibbs transformation ^„ associated to Gn is the mapping 

*„ :Ai e ViSn) ^ *„(m) e ViSn) with *„(M)(da;) := — — g„(a;)/i(dx). 

tJ-iGn) 

Notice that ^n(/^) can be rewritten as a nonlinear Markov transport equation 



*„(pi)(dy) = (^5„,^)(d7/)= / fi{dx)Sn,f,{x,dy) 
with Sn,f_t{x,dy) := ^,i(a;)4(dy) + (1 - C;„(a;))t/„(y)/i(dy)//i(C/„). 
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Let {rjmTjn)n>o be the flow of probabflity measures, both starting at 770 = fyoi and 
defined for any n > 1 by the following recursion 



Vn > 77„+i = rjnMn+l with T]n ■■= '^niVn) = VnSn^r, 



(3.2) 



It can be checked that the solution {rjmrjn) of these recursive updating prediction equa- 
tions have the following functional representations: 

??«(/«) =7«(/n)/7n(l) and ??„(/„) =7„(/„)/7„(l) (3.3) 

with the unnormalized Feynman-Kac measures 7„ and 7„ defined by the formulae 



7n(/rO=]E 



fn{Xn) n ^k{Xk) 



0<k<n 



and 7„ ( /„ ) = 7„ ( /„ Gn). 



(3.4) 



3.2. Feynman-Kac semigroups 

To analyze SMC methods, we introduce the Feynman-Kac semigroup associated to the 
flow of measures (7n)n>o and (77„)„>o. Let us start by denoting by Q„+i(a;„,da;„+i) the 
bounded integral operator from Sn into Sn+i defined by 

Qn+i{xn,dxn+i) = 5,i (a::,i)7W„+i (x„ , dx„+i ). 

Let (Qp,Ti)o<p<Ti be the corresponding linear semigroup defined by Qp^n = Qp+i Qp+2 ■ ■ ■ Qr. 
with the convention Q„_„ = /, the identity operator. Note that Qp^n is alternatively de- 
fined by 



Qp,n{fn){Xp)^^ 

Using the Markov property, it follows that 



/„(-%-„) J] gk{Xk)\Xp = x 

p<.k<.n 



(3.5) 



7n(/n 



:E 



E 



fn{Xn) n Sk{Xk)\Xp Y[ gfc(A'fc) 
p<k<n -' 0<k<p 



-'IpiQpAfn))- 



The last assertion shows that (Qp.n)o<p<n is the semigroup associated with the unnor- 
malized measures (7„)ri>o- Denote its normalized version by 



' p,n\j7i) '•- 



^p,n[Jn) 

Qp,„(i) ■ 



(3.6) 



Finally, denote by ($p.n)o<p<n the nonlinear semigroup associated to the flow of nor- 
malized measures {T]n)n>o' ^p:n = ^n o • • • o $p+2 o $p+i with the convention $„_„ = /, 
the identity operator and $,i(//) = ^J■{gn-l■Mn)/^J■{Gn-l), M £ 'P{Sn-i)- Note that 
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($p,Ti)o<p<Ti can be alternatively defined in terms of (Qp.n)a<p<n using 

<T> (^ \( f \ ^ lp^p,n{jn) _ 11pQp,n(Jn) /„ _n 

'i'p,nVlp)\Jn) — -p^ rrV ~ r\ 7TV' \'^-') 

7p2p,n(l) ?7pQp,n(l) 

3.3. Path space and excursion models 

Let {Xn)n>o be a Markov chain taking values in some measurable state spaces En with 
elementary transitions M„(a;„_i,dx„) and initial distribution 770 = Law(Xo). In addi- 
tion, introduce a sequence of non-negative potential functions (G„)„>o on the state 
spaces {En)n>o- To simplify the presentation, it is assumed that G„ G (0, 1) Vn > 0. 

We associate to an increasing sequence of time parameters (i„)n>o the excursion- valued 
random variables Xq for n — Q and Xt^_^+i:tri for n > 1. We also define the random path 
sequences 

with the convention E'^ := Eq x ■ ■ ■ x En- Note that {Xn)n>o forms a Markov chain 

^n+l -^ ('%'n,^t„ + l:t„+i) (3-8) 

taking values in the excursion spaces Sn'-= E[ . Now adopting the potential functions 

Vn>l gn{Xn):^Wt„_,:tAXt,,-i+i:tJ (3.9) 

in (3.4). we readily find that 



7n(/„)=E 



fn{Xn) n ^'^('^^ 



0<k<7i 



= E[/„(Xo:tJWo:t„_,(Xl:t„_J]. 



By definition of the potential functions Qn of the excursion Feynman-Kac model (3.9), 
it is easily proved that the condition (Q) (equation (3.1)) is satisfied as soon as (G) 
introduced in (2.8) holds true. More precisely, it holds that (G) implies (Q) with 

gn<A/-sup| I (< II g, 

where the essential supremum M — sup{-} is taken over all admissible paths a:t„_i+i:t„ 
and j/t„_i+i:t„ of the underlying Markov chain (X„)„>o. 

3.4. Functional criteria 

In Section 3.3, we have assumed that an increasing sequence of time parameters {tn)n>Q 
was available. We now introduce the functional criteria used to build this sequence. To 
connect the empirical criteria with their limiting functional versions, the latter need to 
satisfy some weak regularity conditions that are given below. 
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Definition 3.1. We consider a sequence of functional criteria 

yn>o,yp<q nl,"l.fiev{E'^)^ n^;;^ (m) e k+ 

satisfying the following Lipschitz type regularity condition 

\ni"^{i^i)~ni-^^{fi2)\<s{HJ,-^) [\[f^^~f^2m\H^^{dh) (3.10) 



for some collection of bounded measures Hp"q on Bb{E'^) such that 



(5(il("J):=y'osc(/i)ij(;)(d/i)<oo. 



We illustrate this construction with the pair of functional criteria discussed in Sec- 
tion 2.4.1. When we consider (2.6), the functional 



H(",H/i)=/^ 



Wp., ;' 



m(W^p,,) 



(3.11) 



coincides with the squared coefficient of variation of the weights w.r.t. ii. When we 
consider (2.7), the functional 

?^(,",)(/i) =Ent(d/i|M^p^,d/i) -.^ -^i{\ogWp^q) (3.12) 

measures the relative entropy distance between ^ and the updated weighted measure. Un- 
der the condition {Q) stated in (3.1), it is an elementary exercise to check that the above 
pair of criteria satisfy (3.10). In the first case (3.11), we can take i?p"g = c[5\y^ + 5w ] 

for some constant c sufficiently large. In the second case (3.12), we can take Hp^q = c5w , 
again for some c large enough. 

3.5. Resampling times construction 

We now explain how to define the sequence of resampling times {t„)n>o- This requires 
introducing the measure P,,,(p,„) G 'P{E'^) defined for any pair of integers < p < n and 
smyj^eViE'p) by 

P»7,(p,«)(c^a;o:„) := r]{dxo.,p)Mp+i{xp,dxp+i) ■ • •M„(a;„_i,(ia;„) 

e r{E;^ X {Ep+i X • • • X £„)) = V{E'J, (3.13) 

where dxo:n denotes an infinitesimal neighborhood of a path sequence xo.n € E!^. 

(n) 

Given Hp^q , with n > and < p < q, we define an increasing sequence of determin- 
istic time steps (t„)„>o and a flow of Feynman-Kac measures {rjmTJn) by induction as 
follows. Suppose that the resampling time i„ is defined as well as {•qmVn) £ "PiE't Y- The 
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resampling time tn+i is defined as the first time (s > t,i) the quantity T~Lt'^]s^fj„.{t^,s)) 

hits the set /„ = [a„,oo); that is, i„+i :— inf {i„ < s: 'Hj",s(Pij„.(t„^s)) G In}- Given i„+i, 
we set 

rin+i^^Tu,{t^,t^+-L) and 7/„+i = *„+i(?7„+i) (3.14) 

with the Bohzmann-Gibbs transformation ^„+i associated with the potential function 

By definition of the Markov transition Ain+i of the excursion model Xn defined in 
Section 3.3, it can be checked that 

rjn+l = Pr7„,(t„:t„ + l) = VnMn+l- (3.15) 

This yields the recursion ((3.14) and (3.15)) => rjn+i = ^„(?7„)A^„+i. Hence the flow 
of measures ?/„ and rfn coincide with the Feynman-Kac flow of distributions defined 
in (3.3) with the Markov chain and potential function {Xn,Gn) on excursion spaces 
defined in (3.8) and (3.9). The SMC approximation of these distributions is studied in 
Section 4. 



3.6. Some applications 

In this section, we examine the inductive construction of the deterministic resampling 
times (i„)„>o introduced in Section 3.5 for the criteria (2.6) and (2.7). 

• Squared coefficient of variation. In this case, we have 

«t„..l^^„.(*„,.)i - E,,5?„(m„,,(X,„+l:,))2 '■ 

The mappings s i— >■ 'Ht"\j(P7,^.(t„.s)) are generally increasing. One natural way to control 
these variances is to choose an interval /„ := [a„, c»), with a„ > 0, then 

tn+i :=inf{i„ < s: E„,^„(m„,,(Xt„+i:,)2) > [1 + a„]E„^fj^{Wt^^s{Xt„+i:s))^}. 

• Entropy. This criterion allows us to control an entropy-like distance between the free 
motion trajectories and the weighted Feynman-Kac measures. To be more precise, set 

^S(%,(*„,.))=Ent(P,-j„, (,„,,) |Q,-j„^(,„^,)) = -E„,,7„ (log m„..(^t„+i:s)) 
with the weighted measures Q,,,(p,„) defined by 

If we choose an interval /„ :~ [a„,oo), with a„ > 0, then the resampling time i„+i coin- 
cides with the first time the entropy distance goes above the level a„; that is, 

tn+i ■■= inf {t„ < s: En.t{Ffj^^(^t„,s)\Qfj„,(tr.,s)) > an}- 
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4. Convergence analysis of the reference SMC 
algorithm 

4.1. A reference SMC algorithm 

The SMC interpretation of the evolution equation (3.2) is the Markov chain 

with elementary transitions 

nxim e Si X . . . X S^lAfW) = / \{^n+i,n-ixL''''\dxl^,), (4.1) 

where Bi g o5^,i+i for every i S {1, . . . , N} and 



1 ^ 
/C„+i_,,iv =5„_,,«A^„+i and Vni') ■= J^^^xi,'^.f>i-)- (4-2) 

This integral decomposition shows that the SMC algorithm has a similar updat- 
ing/prediction nature as the one of the 'limiting' Fcynman-Kac model. More precisely, 
the deterministic two-step updating/prediction transitions in distribution spaces 

Vn " "" > Vn = TlnSn;,u = ^nC'?") ^^^ ^"+1 = VnMn+l (4.3) 

have been replaced by a two-step resainpling/mutation transition in a product space 

^^JV) ^ gN '-"sampling ^ -^N) ^ gN mutation ^ ;^(^JV) ^ ^^^^^ ^ ^^ ^^ 

In our context, the SMC algorithm keeps track of all the paths of the sampled parti- 
cles and the corresponding ancestral lines arc denoted by Xn '''' = X^-t ^^-^ Xn = 
Xq.j' S S^, where we recall that Sn = £[ . By definition of the reference Markov 
model Xn given in (3.8), every path particle A'^+i G S^^-^ keeps track of the selected 

excursion <¥„ '* S S^ and it evolves from its terminal state X^. ^ with (i„+i — i„) 
elementary moves using the Markov transition Alt^^i-t^^-^. More formally, we have that 

y{N,i} _ fy{N,i} y{N,i) \_(y(N,i) -^(Af,0 ^ 



From this discussion, it is worth mentioning a further convention that the particle em- 
pirical measures rj^+ii-) = jf^i=i^(^(^,i) j^(n.o •,(•) are the terminal values at time 

s = tn-t-1 of the flow of random measures 



N 



tn < 5 < t„+i ^P^. (,^ ,)(•) ^ ^J2\xi--\xi:-lJ-y (4-5) 



i=l 
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4.2. Concentration analysis 

4.2.1. Introduction 

This section is concerned with the concentration analysis of the empirical measures r]^ 
associated with (4.2) around their limiting values ri„ defined in (3.3). Our concentration 
estimates are expressed in terms of 

qp,n= sup J*'" and /3{Vp,„) -.^ sup osc(Pp,„(/)) 

with Qp^n as in (3.5) and Vp^n in equation (3.6). These parameters can be expressed 
in terms of the mixing properties of the Markov transitions A^„; see [4], Chapter 4. 
Under appropriate mixing type properties we can prove that the series X]p=o l'p,nl^{'Pp,n) 
is uniformly bounded w.r.t. the final time horizon n for any parameter a > 0. Most of 
the results presented in this section are expressed in terms of these series. As a result, 
these non-asymptotic results can be converted into time uniform convergence results. To 
get a flavor of these uniform estimates, assume that the Markov transitions Aik satisfy 
the following regularity property. 

{Ai)m There exists an tti S N and a sequence {dp)p>o E (0, 1)'*' such that 

Vp>0, y{x,y)eSp Mp^p+rn{x,-)>SpMp^p+miy,-) 

with Mp,p+m :== Mp+iMp+2 ■ ■ -Mp+m. 
We also introduce the following quantities: 

yk<l r,.:=supnff^ (<Ul^ 

k<p<i^p^yp> ^ k<p<i ' 

with the collection of constants (gn)>i introduced in (3.1). In the above displayed formula, 
the supremum is taken over all admissible pairs of paths with elementary transitions M.p. 
Under the condition (A^)m we have for any n > 771 > 1, and p > 1, 

\jijra\ —1 

gp,P+«<'5-Vp,p+„ and ^(7'p,p+„)< J]^ (1 - '^p+A:m+i^p'+fc™+i,p+(fc+i)„J- (4-6) 

fe=0 

The proof of these estimates relies on semigroup techniques; see [4], Chapter 4, for details. 
Several contraction inequalities can be deduced from these results. To understand this 
more closely, assume that {M)m is satisfied with m = 1, (5 = /\„ i5„ > and q = Vn>i 9ra- 
In this case, Qp.p+n < 5^^q and /3(7^p,p+n) < (1 ^ S'^)^ imply that 

n 

Va>0 ^^^^^(^P,")!^?"/^^'^"^- 

p=0 

More generally, assume {M)m is satisfied for some ?7i > 1 and that the parameters Sp 
and rk^i are such that 

f\Sp:^S>0, \frp^p+jn.= r<(X) and \/ rp+i,p+rn ■=L< co. (4.7) 

p p p 
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In this situation, qp.p+„ < S~^r and (3{Vp.p+n) < (1 ~ ,52^,-1 ^[n/mj ^^^ therefore 

n 

V«>0 J2<nP{Vp,n)<mrr''/6^^+"'>. (4.8) 

See [4], Chapter 3, for a discussion of when {M)m holds. We also mention that this 
mixing condition is never met for Xn = (-^p)o<p<t„ on Sn — E[ discussed in Section 3.3. 
Nevertheless, under appropriate conditions on the Markov transitions Affc, it is satisfied 
for the time marginal model associated with the excursion valued Markov chain model 
on nt„_i<p<t„ Ep- For instance, if Vfc > 1, V(x,y) e (£'fc)^, Mk{x, ■) > S'Mkiy, •) for some 
5' > 0, then condition {A4)m is niet with m~l and Sp = S' . 

4-2.8. Some hj-n-mean error bounds 

At this point, it is convenient to observe that the local sampling errors induced by the 
mean field particle model are expressed in terms of the collection of local random field 
models defined below. 

Definition 4-1- For any n>0 and any N > 1, let V^^ be the collection of random fields 
defined by the following stochastic perturbation formulae 

€ = ^^i/C„,„v + ^C (^ Kf := ^[V^ - ^^i^„,,« J)- (4.9) 

" V-'V " 

For n = 0, the conventions /Cq „« (a:, dy) = rio{dy) and ri^iK,Q .„n = r]o are adopted. 

In order to quantify high-order L„i-mean errors we need the following Khinchine type 
inequality for martingales with symmetric and independent increments. This is a well- 
known result. 

Lemma 4.2 (Khinchine's inequality). Let L^ '■~^o<p<n'^p ^^ ^ real-valued mar- 
tingale with symmetric and independent increments (A„)„>o. For any integer m > 1 and 
any n>0, we have 

E(|L^r")i/'"<6(m)E([L^]™'/')^/"' wtth [L^U -.^ ^ A^, (4.10) 

0<p<n 

where m' stands for the smallest even integer m' >m and {b{m))„i>i is the collection of 
constants given below: 

6(2m)2™ := (2m)„2-™ and h(0^ + 1 )2'»+i ■= ^^"^ + l)("^+ i ) 9-(m+i/2) (4^^^) 

A/m + 1/2 

with (2m)m = {2m)\/{2m — 771)!. 
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Proposition 4.3. For any N >\, m>l, n>Q and any test function fn G Bb{Sn) we 
have the almost sure estimate 

E(lKf (/n)n4-l)'^'" < h{m)osc{U), (4.12) 

where (Jvi )n>o is the filtration generated by the N -particle system. 

Proof. By construction, we have 

N 

Kf(/„) =EAi7(/«), 
1=1 

Ai^Vn) :- -j=[fn{Xi''-^^)-IC^,„.Jfn)ixi-f)]- 



Given A',j_(, let (3^„ ' )i<j<Ar be an independent copy of {Xn ' )i<i<Ar- It can be 
checked that 

Ai^)(/„) = Ef 4=[/„(A'r-)) - fM'^-niH''^ 



This yields the formula Vj^{f„) — E{lI^ ^{fn)\Tn ), where i„7v(/n) i^ ^^^ terminal 
value of the martingale sequence defined by 



j)> 



^e{l,...,N}^ lW(/„) := 1 ^[/„(A'r^^-)) - /„(3;C^ 
Then as 

one may apply Khinchine's inequality to conclude. D 

The proof of the following lemma is rather technical and is provided in the Appendix. 

Lemma 4.4. For any <p<n, any r],fi€ V{Sp) and any /„ e Osci(S'„), we have the 
first-order decomposition for the nonlinear semigroup $p,n defined in (3.7): 

where 

\npAl^.V){fn)\<Ml,A'Pp,n)\[l^-V]{Vp.nM))\ >< I [A^ " ^] (Wp,n,. (/«)) I 

with Up^n.ri{f)T^p.n,ri{f),y^p,n,riif) CL Collection of functions in Osci{Sp) whose values 
only depend on the parameters {p,n,r/). 
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We now present a bias estimate and some L„j bounds of independent interest. 
Theorem 4.5. For any n > 0, /„ G Osci(5'„) and any N >l, 

n 

In addition, for any m>l we have 



with a2^n ■='2j2p=0lp.nP{'Pp,n)- 

Proof. Using Lemma 4.4. we have the telescoping sum decomposition 



p=0 

with rj^iif) := / and the pair of random measures [I^ ,J^) given for any /„ 6 Osci(S'„) 

by 

n 

p=0 
n 
J^ifn) ■■= ^Y.'^pArip .%{Vp-l)){fn). 

p=a 
Now, observe that 

nW:'ifn))=nJnifn)). (4.13) 

Using Proposition 4.3, for any /„ € Osci(S'„) it can be checked that E(|I,7(/„)|™)i/™ < 
b{m)a2.n- In a similar way, we find that 

^EdJ-j^aJI™)!/™ < 6(2m)Vi.„. (4.14) 

The first part of the proof then follows from (4.13) and (4.14); the remainder of the proof 
is now clear. D 

4-2.3. A concentration theorem 

The following concentration theorem is the main result of this section. 
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Theorem 4.6. For any n > 0, /„ G Osci(S'„), N>1 and any < e < 1/2, 

n\[v?. - ^n](/n)l > e) < 6exp (-^) , (4.15) 

where the constant cri^„ is as in Theorem 4-5. 

In addition, suppose {A4)m is satisfied for some m> 1 and condition (J^.l) holds true 
for some S > and some finite constants {r,r). In this situation, for any value of the 
time parameter n, for any fn G Osci(S'„), iV > 1 and for any p G (0, 1), the probability 
that 



,r N 1/ ,. M 4r 2mrr , /6 

IK^ -..](/.)! <^J^^ log (- 



is greater than (1 — p). 



Proof. We use the same notation as in the proof of Theorem 4.5. Recall that 6(2™)^™ 
E(X^™) for every centered Gaussian random variable with E(X^) = 1 and 

Vs e [0, 1/2) E(exp {sX^}) = ^ ■^b{2mf"^ = -== 



Using (4.14), for any fn G Osci(S'n) and < s < l/(2cri,n), it follows that 

E(exp{.V7V^,f (/„)}) < E ^^^i^6(2m)2- = \ . (4.16) 

To simplify the presentation, set 

/p,n •=^p,n,*p(j;^_i)(/") ^-^d ap,„ := 2(7p^„/3(T'p^„) , 
where Up^n,ri{') was introduced in Lemma 4.4. By the definition of Vl^ 

1 ^ 

^ ^^ i=l 

Recalling that E(e*''^) < e*'^ ^^ for every real-valued and centered random variable X 
with |X| < c (e.g., [4], Lemma 7.3.1), we prove that 

E(exp{top,„y/(/^^J}|A-j^,)) 

= 11/ ^p,<_iKp-i 'da;)e """-1 <exp(i ap_„/2). 



Adaptive SMC 17 

Iterating the argument, we find that 

E(e*^"(/"))=ELpL5:a,,„F/(4^„)|') < cxp (^) (4.17) 

witha2:=4E;.o'Z^,n/3(^P,«)'- 

From these upper bounds, the proof of the exponential estimates now follows standard 

arguments. Indeed, for any < s < 1/(2(Ti_„) and any e > 0, by (4.16) we have 
n^Ju{fn)>e) < .^ \ exp{-£g}. 

^1 - 2SCT1,„ 

Replacing s by eN and choosing s ~ 3/(8cri,„) yields 

nJn{fn)/^>e) < 2exp{-eiV/(3ai,„)}. 
To estimate the probability tails of X^(/„), we use (4.17) and the fact that e > and 



Now, choosing t = e/af-^ and replacing e by \/Ne, we obtain 



Ve > P(i;^ if)/VN > e) < exp - 



, 2a2 
Using the decomposition 

k^-•/7„]=J,r/^/]v + J,f/^/iV 
we find that for any parameter a G [0, 1] 

niVn - Vn]{fn) > s) < P(Z^ (/„)/ ViV > «e) + P( J'„^ (/„)/ VA^ > (1 - a)s). 
From previous calculations, 

IP([^^-'7n](/™)>e)<cxp(^-^-^j+2exp(^ ^^^j- (4.18) 

Now, choose a = (1 - e)(> 1/2), then a^ > 1/4 and 

n[€ - VnKfn) >e)< exp y-^^j + 2cxp [-^^ 

Ni ~ 



< 3 exp . „ , „ , 
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It remains to observe that gp_„ > 1 and P{Vp^n) < 1 =^ <^n — "^i-" ^^'^ 

\[Vn~Vn]ifn)\>e ^=^ [€ - rin]{f n) > e Or [r?^ - 7^] (/„) < -£ 
■^=^ [^7,^ - Vn] ifn) > £ or [t]^ - ^n] (-/„) > s 
so that 

mV:! - Vn]{fn)\ >£)< P([r/,^ - Vn]{fn) > s) + AiV^ Vn]{- fn) > s) . 

The end of the proof of (4.15) is now easily completed. We now assume that the mixing 
condition {A4)m is satisfied for some m>l and condition (4.7) holds true for some (5 > 
and some finite constants (r,^). By (4.8) the following uniform concentration estimate 
holds 

sn^n\[€ - Vn]{.fn)\ > e) < 6exp -— ^ 
„>o V o2mrr^ 



1 4r / 2mrr , 6 



The proof of the theorem is concluded by choosing e := ^=|5 W — j^ log -. D 

Remark J^.l. Returning to the end of the proof of Theorem 4.6, the exponential con- 
centration estimates can be marginally improved by choosing, in (4.18), the parame- 
ter a = a„(e) G [0, 1] such that an{e)c? = 6„(1 — a), with a„(£) := -^■, bn — -^ — and 

'^n '■— ^J2p=o1p,nl^{'Pp,n)^ ■ Elementary manipulations yield 



,, bn f /, 4a„(£) 



2a„(e) 
cr,2j 1 / /, , 6(71, „ 



and therefore 

Ve > n\{€ - ^/n)(/)| > e) < 6exp (-N^al{e) 

\ ~^^n 

For small values of e, this bound improves that in Section 7.4.3 of [4], which is of the 
form 



Ve > P(|(77^ - 77„)(/)| > £) < (1 +£VA^)exp {~N— 
with 

\p=0 / 
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4.3. Approximating the criteria 

By construction, the particle occupation measures P^ ,, ^s approximate the mea- 
sures P;j„,(t„.s) introduced in (3.13); that is, in some sense, P:^ ,^ ^s ~jv-^qo ^fi„,{tn,s)- 
Conversely, observe that P^ ,^ ^., respectively P;f„,(t„.s), are the marginals of the mea- 
sures rj^+i, respectively jyn+i, w.r.t. the (s — i„) + 1 first coordinates. In other words, 
the measures P^ ,^ ^s, respectively P^„,(t„,s)i are the projections of the measures ??^i, 
respectively i]n+i, on the state space E'^ = E[^ x (£'*„+ 1 x • • • x iS^). 

For instance, the following proposition is essentially a direct consequence of Theo- 
rem 4.6. 

Proposition 4.8. For any N >\, n>Q, tn < s < in+i and any e > 0, the concentration 
inequality: 

P(l<'!s(Pe,(t.,«)) -^5(%,(*.,«))l >£) < il + eVN/2)exp {-^) 
holds for some finite constant c{n) < oo whose values only depend on the time parameter. 

(n) 

In addition, when the measures Hi \, have a finite support, the concentration inequality 

also holds, with a pair of finite constants ci(n),C2{n) < oo. 

Proof. By [4], Theorem 7.4.4, for any N >1, p>l, n>Q and any test function /„ g 
OsciEi) 

sup v^E(|77^(/„) - Vnifn^f" < b{p)c{n) 

N>1 

with some finite constant c{n) < oo and with the collection of constants b{p) defined 
in (4.11). These estimates clearly imply that for any i„ < s < in+i, and any test function 

h^eOsciiE'J, 

sup %/]VE(|P^„ ,,^ Ahn)~P^„,it„.s){hn)n'^'' < b{p)c{n). 

N>1 'n A w 

Under (3.10) on the criteria type functionals Ht ^ and using the generalized integral 
Minkowski inequality, it can be concluded that 



sup ^Nn'HZs{^«,iu.s)) - ^i: .(%.(t,..))r)^' < h{p)c{n)5{HrjJ. 

The proof of the exponential estimate follows exactly the same lines of arguments as the 
ones used in the proof of Corollary 7.4.3 in [4]; thus it is omitted. The last assertion is 
a direct consequence of Theorem 4.6. D 
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4.4. An online adaptive SMC algorithm 

The above proposition shows that the functional criteria ^J" s(^>T„,(t„,s)) can be approx- 
imated by Hlj gif'-ff ,^ ^x), up to an exponentiahy smah probabihty. Therefore, as we 
cannot compute the deterministic resampling times (t„), it is necessary to approximate 
the reference particle model: 

Definition 4.9. The particle systemsy^^^ = (3^^^''^), y^^^ = (S^^^''^), ^i.f ''^ andY^^'^'^ 
are defined as A'(^) = {X^^^'^), X^^^ = {X^^''^), and X^f'^ and X^y'^ by replac- 
ing in the inductive construction of the deterministic sequence {tn)n>o the mea- 

TV 

sures Pfj„.{t„,s) by their current N -particle approximation measures Prn (jn 5)(-) := 
4- X^i^i 5,^i,N.i) ^(Af,i) , (•)■ Here r}^{-) ~ 4- '}2i=i ^i;(".o (') denotes the updated occupation 

measure of the particle system 3^„ . We also assume that both models are constructed in 
such a way that they coincide on every time interval <n <m, once the random times 
t^ — i„, for every <n <m. 

—N 

It is emphasized that the measures Pj^n un g\ differ from the reference empirical mea- 
sures P:^ cj ^s in (4.5). Indeed, the reference measures P:^ ,^ ^. are built using the 

deterministic times t„ based on the functional criteria 'Ht_^ si^ffn^i (t„_i s)), whilst the 



empirical measures Psw (^n g) arc inductively constructed using random times t^ based 



on H 






By construction, for the pair of functional criteria discussed in Section 3.6, we have that 
HIm gi^fi" ,(t" ,s)) — ^t« g, where C^ ^ are the empirical criteria discussed in Section 2.3. 

5. Asymptotic analysis 

5.1. A key approximation lemma 

To go one step further in our discussion, it is convenient to introduce the following 
collection of events. 

Definition 5.1. For any 5 £ (0,1), m>0, a„ G K and N >1, we denote by ^^{S, 
io,n)o<n<m), the Collection of events defined by: 

0^(5, (a„)o<,i<,n) := {VO <n< m,\ftn <s< i„+i 
The proof of the following result is straightforward and hence omitted. 
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Lemma 5.2. On the event ^f^{5, {a„)o<n<m) , for any n <m and for any t„ < s < in+i, 
we have 

Proposition 5.3. Assume that the threshold parameters an are chosen so that 
N >1, we have 



'^t„si^fj„.{t„,s)) ¥" o,n, for any n>0. In this situation, for any S € (0,1), m>0 and 



fl {t^=tn}^nZiS,ian)o<n<m). 



0<n<??i 



Proof. This result is proved by induetion on tti > 0. Under our assumptions, for m = 
we have tg = to = 0. Thus, by our couphng construction the pair of particle models 
coincide up to the time {t^ A ti). Therefore, we have 



V,s<(tfAti) F^„. .=P^«.„ 



By Lemma 5.2, on the event ^^{S, {an)o<n<m) we have t^ = ti. This proves the inclu- 
sion for m ~ and m ~ 1. Suppose the result is true at rank m. Thus, on the event 
J7^((5, (a„)o<n<m) it is the case that t^ = i„, for any <n <m. By our coupling con- 
struction, the pair of particle models coincide up to (i^+i A i,„+i); that is, 

*m=^m ^nd Vs < (i„^i Ai,„+i) ^fj^,(t„,s)=^n^.{t^.s)- 

Once again, by Lemma 5.2, on the event i^m+i(^' (^n)o<n<m+i) it also follows that 

iN _ -I ^ ^ n 

5.2. Randomized criteria 

The situation where the threshold parameters coincide with the adaptive criteria val- 
ues ^t",s(Pi?„,(t„,s)) = «ra cannot be dealt with using our analysis. This situation is 
more involved since it requires us to control both the empirical approximating crite- 
ria and the particle approximation. It should be noted, however, that this is not a dif- 
ficulty in many applications where the probability of this event is zero. Nonetheless, 
to avoid this technical problem, one natural strategy is to introduce randomized cri- 
teria thresholds. We further assume that the parameters (a„)„>o are sampled real- 
izations of a collection of absolutely continuous random variables (A„)„>o. The main 
simplification of these randomized criteria comes from the fact that the parameters 
£,„ := info<„<m mitr,<s<t„+i \T~l-Z]si^ii„.,{t^,s)) ~ ""I ^"^'^ strictly positive for almost every 
realization A„ ~ a„ of the threshold parameters. 

Theorem 5.4. For almost every realization of the random threshold parameters, and for 
any (5 G (0,1), we have the following exponential estimates: 

P(30 <n<mt^^ i„|(A„)o<„<™) < ci{m) M + ^m^ y ] exp {~NSh^Jc2im)) 
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for some constants Ci{m),C2{m) <oo. In addition, when the measures Hf s have a finite 
support, for any Sg (0,l/(2em)), 

P{30<n<mt^^tn\{An)a<n<m)<ci{m)c^p{~NS^el^/c2{m)) 

holds for a possibly different pair of finite constants ci{m),C2{m) < oo. 

Proof. Using Proposition 4.8, we obtain the rather crude estimate 

P(0 — fl„i{S, {An)o<n<m)\{An)o<n<7n = {a.,i)o<n<m) 

<T.T. ip(i<"!..(pC.(*„,^)) - <"!.(%.(*..^))i > '5|h5(p,?„,(*„,s)) - «„i) 

n— s—tn 



< E E ip(i^*::.(pC,(*„,.)) - m:U^vut.,^))\ > fe™) 



n— s—tji 

< ci(to)(1 + fe,„0v72)cxp(-iVj24yc2(m)) 



for a pair of finite constants ci{m),C2{m) < oo. The final line is a direct consequence of 
Proposition 4.8 and an application of Proposition 5.3 completes the proof. D 

We conclude that for almost every realization {An)o<n<m ~ {o-n)o<n<m the pair of 
particle models (Xn \Xn )o<n<m and {y^^\yn )o<n<m only differ on events Vt — 
i7^((5, (a„)o<n<m) with exponentially small probabilities: 

P(30 <n<m (3^(^\5^W) ^ (AfW, A=i^))|(A„)o<„<™ = (a„)o<„<™) 



< ci(to)(1 + fc,„V7V72) exp {- N S"" elJ C2{m)) . 

6. A functional central limit theorem 
6.1. A direct approach 

In this section some direct consequences of the exponential coupling estimates are dis- 
cussed. For almost every realization (A„)o<n<m = (an)o<n<m and for any test function 
/„ G Osci{E[ ) the following decomposition holds (writing 77^ for the online adaptive 
approximation introduced in Definition 4.9): 



/N[rj': - vn] = ViVK^ - ,;„] + VN[r]': - C]ln-o«(^.(a„)o<„<„) 
with 

E{VN[r]^ - ^^](/r0ln-n^(5,(a„)o<„<„)) < ^H^ - <('5, K)o<n<™)) ■ 
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Thus we can conclude directly that, for almost every realizatfon (A„)o<ri<rn = 
(an)o<n<m, thc random fields 



W^ := VN[-^': - 77„] and Wj,' := ViV[?y^^ - r?„] 
converge in law, as N^oo, to the same centered Gaussian random field Wn- 

6.2. Functional central limit theorems 

To demonstrate the impact of this functional fluctuation result we provide a brief discus- 
sion on the proof of the multivariate central limit theorem. We first recall the functional 
fluctuation theorem of the local errors associated with the mean field particle approxi- 
mation introduced in (4.9). This result was initially presented in [5] and extended in [4]. 

Theorem 6.1. For any fixed time horizon n > 0, the sequence {Vl^)o<p<n converges 
in law, as N tends to infinity, to a sequence of n independent, Gaussian and centered 
random fields (T^)o<p<n with, for any fp, gp G Bb{E' ), and 1 <p <n, 

^{Vp{fp)Vp{gp)) ^ rip^iKp^rj^_,{[fp ~ Kp^rj^_,{fp)][gp ~ Kp^n^_,{gp)]). (6.1) 

Using arguments similar to those in the proof of Lemma 4.4, we obtain the decompo- 
sition formula: 

[$„(aO - <J^n(^)](/) = (a* - 77)2?„,,(/) +7^„(A.,r,)(/) 
with the signed measure 7?.„(/i,?7) given by 

7^„(/i,77)(/) := 7^^[l^ - ri\®''{Qn,^®T^nM)) with Qn,n ■■= Qn-lhl{Qn-l), 

P„,„(/)(a;) := g,,,-,{x) x MM - <i>n{v)im^)- 

Definition 6.2. Denote by Dpn the semi-group associated to the integral operators 
Dn := 'Dn,Tf„_i; that is, Dpn '■— Dp+i- ■ ■ Dn-iDn- For p — n, we use the convention 
Dn,n = Id, the identity operator. 

The semigroup Dp^ can be explicitly described in terms of the semigroup Qp_„ via 

The next lemma provides a first-order decomposition of the random fields W^ in 
terms of thc local fluctuation errors. Its proof is in the Appendix. Note that Rp can be 
understood in the proof. 

Lemma 6.3. For any N >\ and any <p <n, we have 

n n— 1 

Wn=Y.^p''^P'^+'^n withn';',:=VNY,Rp+i{ri^,r^p)Dp+^^r.- (6.2) 

p=0 p=0 
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Using the Lm-mean error estimates presented in Section 4.2.2, it is easily proved that 
the sequence of remainder random fields TZ^ in (6.2) converge in law, in the sense of 
finite distributions, to the null random field as iV t oo. Therefore the fluctuations of W^ 
follow from Theorem 6.1. 

Corollary 6.4. For any fixed time horizon n > 0, the sequence of random fields (VF^)„>o 
converges in law, as N '\ oo, to a sequence of Gaussian and centered random fields 
{Wn)n>o, where Vn > W„ = YTp=o ^v^P.-n- 

6.3. On the fluctuations of weighted occupation measures 

We end this article with some comments on the fluctuations of weighted occupation mea- 
sures on path spaces. Returning to the online adaptive particle model, given {t^ ,t^+i) = 
(i„,i„+i) the iV-particle measures 77,^, ^ = -^ 1].=! '5,,-^(n,,) ,y{N,^) ^(n.,) ^{na)-.-. can be 

used to approximate the flow of updated Fcynman-Kac path distributions {rjn+i.s)tn<s<t,^+i 
given for any bounded test function fn+i <= l3b{Sn+i) by 

S e [tn,tn+l] ^ rjn+l.s ifn+l) OC E[/„+i (Xo:t„_|_i ) Wo:s (^l:s)] ■ 

Indeed, if we choose 

T„+i(/„+i)(a;o:t„+i) :=/«+i(a;o:t„+i)Wt„:s(a;t„+i:s), 
then in some sense 

^N (f N _ ^n+l(^n+l(/n+l)) ^ /. s _ ^"+1 (r„_|_i (/„+i)) 

'7„+l(^n+l(l)) 77n+l(T^+l(l)) 

where ?7n+i is the flow of Fcynman-Kac measures on path spaces introduced in Sec- 
tion 3.3. 

Since the adaptive interaction time is taken such that t^_^_i = t„+i, it holds that 

1 ^ 

T7 y^ <^v(".«) —N-foo ?7n-|-l,t„ + l = Vn+1- 

4=1 

In other words, if the marginal type functions are chosen such that 

T'„+i(/n+i)(a:^0:t„+2) := /n+i(a;o:t„+i) 



so 



.(0) 



??«+2(T'J; + i(/„+l)) = ?y„+l(/n+l) OcE[/„+l(Xo:t„^JWo:t„ + i(Xl:t„^J], 

N 

N 



1 ^ 

Vn+'liTn+lifn+l)) = — 2_, /" + 1 (3^n+l ) -N^oo 'M+2 (r„+i (/«+l )) ■ 



1=1 
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From the previous discussion, for almost every realization (>ln)o<n<m = (an)o<n<m, 
a central limit theorem (CLT) is easily derived for the collection of random fields 

t?„^+f (/„+i) := VA^[77ir+2(Ti"+\(/„+i)) - nn+2{T!^Mfn+i))l 

as well as for the mixture of random field sequences 

^rf+i,. = hs<s<t-^W^+['!, + l,^t.^W^^'-°\ (6.3) 

The fluctuation analysis of these random fields relics on the functional CLT stated in 
Corollary 6.4. In particular, the fiuctuations of the random fields (6.3) depend on those 
of a pair of random fields. 

6.4. Related work 

Reference [6] is the only published paper discussing a convergence result for an adaptive 
SMC scheme. The authors establish a CLT using an inductive proof w.r.t. deterministic 
time periods. They avoid the degenerate situation where the threshold parameter coin- 
cides with the limiting functional criterion. More recently, this problem has also been 
addressed in [2], Chapter 4. However, the author does not account for the randomness 
of the resampling times in his analysis. 

Appendix 



Proof of Lemma 4.4. Via (3.7), for any / G Bb{Sn+i) we find that 
[%.n (aO - *P,n ('?)] (/) = -77; V (^ ~ ^)^p.».'; (/) ' 

where Gp,nji ■= Qp,«(l)/'7(Qp,n(l)) and Pp,„(/) = Qp,,i(/)/Qp,„(l). Now, since 77(5p,„,,,) = 1, 
it follows that 

[$p,„ (/i) - $p,„ (77)] ^i^i- V)'^p,n,r, + Tlp.n (^7 J?) , 

np,n{^^,V)if) -^ 77;^[f^-vf\Gp,n,^®Vp^r.,r,{f)). 

Using the fact that 

Vp^n,n{f){x) = Qp,n,ri(x) / [Vp,n{f){x) - 'Pp,n{f){y)]Qp,n,ri{y)ri{dy) 
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we find 

V/ e 0sCi(5„) \\Vp^nM)\\ < Qp.nPiVp^n). 

Finally, for any / e Osci(5„) observe that 

|7^p,„(M,77)(/)| < mlr.l3{Vp,nmf^-vf\Gp,n,n<»^P,nAf))\ 

with Gp,n,r, := ^p,n,r,/2gp,„ and Pp, „,,,(/) := Dp^n,r,{f)/'2.qp,nl3{'Pp,n) e Osci(5p). D 

Proof of Lemma 6.3. The lemma is proved by induction on n. For n = 0, it follows 
that W^ = Vq^ = y/NiVo - *o(f?-i)], with $o(f?-i) = Vo- Assuming the formula at n 



n ?i— 1 

p=0 p=0 

Letting Z^n+i^n+i = /, it follows that (6.2) is satisfied at rank (n + 1) due to 

n n+1 

Ki+1 +Z^^p Dp^n+l =2^yp Dp^n+1, 
p=0 p=0 

n— 1 n 

p=o p=o n 
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